POWER SERIES COEFFICIENTS FOR PROBABILITIES IN 
FINITE CLASSICAL GROUPS 



JOHN R. BRITNELL AND JASON FULMAN 

Abstract. It is shown that a wide range of probabilities and limit- 
ing probabilities in finite classical groups have integral coefficients when 
expanded as a power series in q^^. Moreover it is proved that the coeffi- 
cients of the limiting probabilities in the general linear and unitary cases 
are equal modulo 2. The rate of stabilization of the finite dimensional 
coefficients as the dimension increases is discussed. 



1. Introduction 

Recently there has been interest in understanding the proportions of cer- 
tain types of matrices over finite fields. For example an n x n matrix is called 
separable if its characteristic polynomial has no repeated roots, semisimple 
if its minimal polynomial has no repeated roots, and cyclic if its characteris- 
tic polynomial is equal to its minimal polynomial. Let SM(n,ij)i ssy[(n^q) and 
CM(n,(j) respectively denote the probabilities that a random n x n matrix over 
¥q is separable, semisimple, or cyclic. Let SGL(n,g)) ssGh{n,q)i CGL(n,(j) denote 
the corresponding probabilities for a random element of GL(n, q). 
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Motivated by questions in computational group theory [15], [18], Neu- 
mann and Praeger [16] proved that for n > 2, 

^ ~ (g2-l)(g-l) < ^^^(-'^) < ^ ~ q^q+l)' 

1 - (^2 - ^'^^^ - l^r' < SUM <l-q-' + + q-'. 

Let SM(oo,q),SSM{oo,q)iCM(oo,q),SGL{oo,q),SSGL(oo,q),CGL(oo,q) be the hmits of 

the proportions defined above as n ^ oo. Using generating function tech- 
niques, it was proved independently in [6] and [21] that 

SM(oo,g) = ~ ^M(oo,g) = (1 " Q"^) JJi^ " Q~l 

r>l r>3 

and 



SGL(oo,g) - 1 - g \ CGL(oo,g) ^ ^_3^ 



+ r 

Wall [21] obtained explicit estimates on the convergence to these limits. 
Concerning the semisimple limits, it was proved in [6] that 

ssMioc,,) = ll^l-q-l n (1-9-^""') 

r>l r>l 

r=0,±2 ( mod 5) 

and 

(1-^-^+1) 



(1 _ g-r) 



r>l 

r=0,±2 ( mod 5) 



From these formulas, it is clear that the limiting probabilities, when ex- 
panded as a series in q^^, have integer coefficients. 

The above proportions have also been studied in the unitary, symplec- 
tic, and orthogonal groups [17], [10], [11]. Aside from the applications to 
computational group theory mentioned in the previous paragraph, there are 
applications to the study of derangements in group actions [8] , [7] and to ran- 
dom generation of simple groups [9]. Formulas for SG(oo,q)> ssGCoo.q); CG(oo,g) 
appear in [10] but are very complicated. For example 

d odd d>l 
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where 

and N{d, q) and M{d, q) enumerate certain sets of polynomials — see Section 
2 for their definition. 

A problem posed in [10] was to understand the integrality properties of 
the coefficients when the limits are expanded as series in q~^. The separable 
case can be treated by adapting any of three quite different existing methods: 
Wall's combinatorial approach for M(d, (7) and GL((i, (7) [21], Lchrcr's repre- 
sentation theoretic approach [13], or the topological approach of Lehrer and 
Segal [14]. However the semisimple case seems difficult by these approaches. 
In this paper we prove a general integrality result which can handle all of 
these cases. 

Another result of this paper is a relation between the coefficients for 
limiting probabilities in the general linear and unitary groups. For instance 
comparing the above formulas for limiting general linear probabilities with 
formulas for unitary limiting probabilities in [10] one observes that 



*GL(oo,?) 


= 1 


- q 


-1 






SU(oo,q) 


= 1 


-q' 


^ - 2g-3 + 4g-4 _ 6^-5 _^ j4^- 


-^-28g-^+52g- 


-^-106g 


CGL(oo,g) 


= 1 


- q 


-3 - + + ^-8 _ g-9 


+ ••• 




CU(oo,?) 


= 1 


- q 


-3 - + q-6 _ 2g-7 + 3g 


-^-5q-' + --- 




SSGL(oo,9) 


= 1 


-q~ 


'^ + q-^-2q-^ + 2q-^-q-^- 


q~^+3q-^-4q- 


-9+... 




= 1 


-q^ 


^-q--^ + 2q-'^-2q-^ + 5q-^- 


-9q-'^ + llq-^- 


20q-^ + 



These expansions suggest, and we prove, that quite generally the coefficients 
in the limiting general linear and unitary expansions are equal modulo 2. 
This is interesting because in the above cases there is a simple closed formula 
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for the general linear limits, but no such formula is known for the unitary 
limits. 

We also establish an integrality result for the coefficients in the expansion 
as a series in of the probability that an element of a fixed group G 
satisfies certain properties; again the methods of [21], [13], [14] do not seem 
applicable at our level of generality. This result gives a slightly different 
approach to a question studied in [21], [13], [14]: how quickly the coefficients 
in the power series expansion of SG(d,g) stabilize to the coefficients in the 
expansion of SG(oo,q)- Results are also given for the cyclic case (studied in 
[21] for Lie algebras of type A). We complement these sharp results by giving 
a general approach to stabilization results which give reasonable bounds for 
a wide variety of cases. 

The organization of the paper is as follows. Section 2 proves the integral- 
ity result for limiting coefficients, and the parity result relating the limiting 
coefficients in the general linear and unitary cases. Section 3 proves the inte- 
grality result for the case of a fixed group. Section 4 uses results from Section 
3 to discuss the rate at which separable and cyclic coefficients stabilize to 
their limits, and proves a stabilization result for more general probabilities. 

For many of out arguments we shall assume that the reader is familiar 
with cycle indices for finite matrix groups, and some of their applications. 
These have been developed in [12] and [19] and, for classical groups, [6]. For 
further developments, see [1],[2],[3],[4]. 

2. Integrality and parity of limiting coefficients 

This section has two purposes. First, it will be shown that many fixed 
q large dimension limiting probabilities have integral coefficients when ex- 
panded as a power series in q~^. The integrality result is established for the 
general linear, unitary, and symplectic groups. There is no need to state 
results for orthogonal groups since (as explained in the remark after the 
proof of Theorem 13) the arguments of [10] show that the corresponding 
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limiting probabilities are obtained from those of the symplcctic group by 
multiplication by easily understood factors. Second, it will be proved that 
the limiting coefficients in the general linear and unitary cases are equal 
modulo 2. Our principal tools are the simple transforms in Lemmas 1 and 
2, and the identities in Lemma 4, taken from [10]. 

Lemma 1. Let f{x) he the formal power series 1 + Ylii>i o-i^^- Then there 
exists a unique sequence {bi) such that f{x) = Y[i>i{^ ~ x^)'^^ . The sequence 
(bi) consists entirely of integers if and only if every ai is an integer. 

Proof. We define the exponents bi recursively. Define 61 := — ai. Suppose 
that we have defined 61, . . . 6„, with the finite product 

n 

Pn{x) := 11(1 - x^)'^ 

i=l 

being equal to 1 + X]i>i '^i-'^*' that we have done this in such a way 
that Cj = ai when i < n. Then we can force Pn+i{x) to agree as far as the 
x"'"'"^ coefficient by defining bn+i '■= c^+i — This is sufficient to prove 

existence and uniqueness of the exponents 6j. It is obvious that if every 
bi G Z, then f{x) has integer coefficients. The proof of the converse is by 
induction; suppose that all the Oj G Z. Then certainly bi G Z. Suppose that 
bi,. . . ,bn are all integers. Then nr=i(-'- ~ ^')''' integer coefficients, and 
so Cn+i G Z, and hence bn+i G Z. □ 

Lemma 2. Let (ai) be a sequence of even integers, and let f{x) he the formal 
power series 1 + '}2i>i'^i^^- Then there exists a unique sequence (bi) such 
that 

i>i ^ ' 

The sequence (bi) consists entirely of integers if and only if every Oj is an 
even integer. 

Proof. We first note that the function when expressed as a power series 
in x', has only even coefficients after the constant coefficient, and that the 
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coefficient of is —2. As in the proof of Lemma 1 wc define 6j recursively. 
First put bi := — Suppose that bi, . . . ,bn have been defined; then define 
the partial product 



Let Pnix) = 1 + X]j>i Cix"^, and suppose that 6i, . . . , 6„ have been defined in 
such a way that = Cj when i < n. Then we can force Pn+i (x) to agree with 
f{x) as far as the x""*"^ coefficient by defining bn+i '■= ^(cn+i — On+i)- Now 
since Pn{x) consists of a finite product of power series with even coefficients, 
it follows that c^+i is even. Since a„+i is even by stipulation, it follows that 
bn+i is an integer. □ 

We define the following quantities, which count certain sets of polynomi- 
als. In this definition, we write for the arithmetic Mobius function. 

Definition 3. Let e{q) be 1 if q is even, and 2 if q is odd. 




(a) 




a\d 



(b) 



N{d,q) 




if d is even. 



(c) 




(d) 




N*{d,q) :={ 



ifd=l, 

if d > 1, d odd. 







(e) 



M*{d,q) ■.= -{N{d,q) 



N*{d,q)) 
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The following lemma brings together several identities from [10], namely 
Lemma 1.3.10 part (b), Lemma 1.3.14 parts (a) and (d), and Lemma 1.3.17 
parts (a), (c), and (e). 

Lemma 4. Let e{q) be 1 if q is even, and 2 if q is odd. Suppose that 
\x\ < q~^. Then 

(a) 



(b) 



(c) 



(d) 



d odd d>l ^ 



l_^d\m<l) ^i-x){l-qx) 



n T 



d odd 



+ x'^J {l+x){l + qx) 



17(1 - rT(i _ ^d-^M'id,q) ^ 

d>i d>i ^ ' 

(e) 



^,l_-x-\''*^''''^ _ 1-qx 



a>l ^ ' 

(f) 

1 — qx'^ 



11^ ' 11^ ^ (l-x)^(9)-i(l + a;)«(9) 

We are now able to state and prove our first results on integrality of 
power series coefficients in Lemmas 5 and 6. Recall that an infinite product 
n„(l + rn) is said to converge absolutely if lln=ii^ + K\) converges, and 
that rinCl "l"^") converges absolutely over a domain D in the complex plane 
if and only if |r„| converges over D. 
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Lemma 5. Let r > q~^, and let (ai) be a series of integers such that the 
product 



N{d,q) 



ajX 



converges absolutely whenever \x\ < r. Then P{q~^) has a power series 
expansion in with integer coefficients. Furthermore, if we define 

M{d,q) 

d odd \ i>l / d>l \ i>l 

and 

N*{2d,q) , s. M*{d,q) 





N{d,q) 1 




1 n 







d>\ \ i>\ J d>\ \ i>l 

then the expansions of Q{q~^) and R{q~^) also have integer coefficients. 

Proof. By Lemma 1, there exists a unique integer series (bi) which satisfies 
1 + Ei>i aix' = ni>i(l - x'f'- We write 



j,di-^biN{d,q) 

d>li>l 

bi 

(1) = n 1 11(1-^*)'^^''''^^ 

i>l \ d>l 

Now for a given i, the product nd>i(l - x'^')^^'^'i^ converges only when 
< q"^. Since P{x) is absolutely convergent when \x\ < r, it follows that 
hi = for any i such that |r|* > q~^. Hence every term nd>i(l ~ x*)'^'^'^'') 
which is present (i.e. has non-zero exponent bi) in the product (1) converges 
when < r. By part (a) of Lemma 4, we obtain 



In particular, this identity is valid when x = q ^, which shows that the 
expansion of P{q~^) in powers of q"^ has integer coefficients. 
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The products Q{x) and R{x) may be treated in exactly the same way, 
except that instead of appeahng to part (a) of Lemma 4, we use part (b) for 
Q{x) and part (d) for R{x). Note also that absolute convergence of P{x) 
for \x\ < r implies absolute convergence of Q{x) and R{x) for \x\ < r, by 
the criterion mentioned before the statement of the lemma. □ 

Lemma 5 is sufficient to deal with limiting probabilities in general linear 
groups. For the other classical groups, we require the following complemen- 
tary result. 

Lemma 6. Let r > q~^, and let (oj) he a sequence of even integers such 
that the product 



N{d,q) 

d>l \ i>l 

converges absolutely for \x\ < r. Define 



A{x) := n h+E 




Bi^) ■■= n 1+E 



Then the power series expansions in q ^ of A{q ^) and B{q ^) have integer 
coefficients. 



Proof. By Lemma 2, we may write 



1 -x*^^' 



i>l i>l ^ 

Now we may proceed as in the proof of Lemma 5, making use of parts (c) 
and (e) of Lemma 4 for A(x) and B(x) respectively. □ 

Lemma 6 leads us to consider the parity of the coefficients (oj) of the 
power series lying within our infinite products. This approach turns out to 
be fruitful in terms of proving integrality of the coefficients of the expanded 
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power series, and will also lead to the somewhat unexpected result given in 
Theorem 15. The following lemma is useful in this respect. 

Lemma 7. Let (ai) and (pi) be sequences of integers. Then the power series 
expansion of 

1 + 

1 + J2^ 

has even coefficients (except for the constant coefficient) if and only if ai — hi 
is even for all i. 

Proof. In the ring Z[[x]] of formal power series in x with coefficients from 
Z, let (2a;) be the principal ideal generated by 2x. If g{x) is invertible (i.e. 
has constant coefficient 1), then we observe that 

M 

This suffices to prove the lemma. □ 



f{x) - g{x) e (2x) ^ g-\x)[f{x) - g{x)) G (2x) ^ M g 1 + {2x). 



We may now bring together Lemmas 5 and 6 in the following way: 

Lemma 8. Let r > q~^, and let (oj) and (bi) be sequences of integers such 
that ai — hi is even for all i, and such that the products 

N{d,q) 

d>l \ i>l 

and 

N{d,q) 

d>l \ i>l 

are absolutely convergent for \x\ < r. Define 

/ \N{d,q) I \M{d,q) 



d odd 



/ d>l \ i / 

/ \N*(2d,q) / 

G{x) := n n 



N*(2d,q) / X M*{d,q) 

di I 



jX 



d>l \ i / d>l \ i / 

Then F{q~^) and G{q''^) have power series expansions in q~^ with integer 
coefficients. 
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Proof. We may rewrite F{x) as 

N{d,q) / \ ^id.,q) 

di \ 



X 



p) - n (Itw) ' n [^^Y.". 

dodd ^ * dodd V i 

/ \ M{d,q) 

(i>l V i J 

Now by Lemma 7, the quotient 

expands with even coefficients except for the constant term. It follows from 
Lemma 6 that the first of the three infinite products in (2) expands with 
integer coefficients. And by Lemma 5, so do the second and third products 

taken together. This proves the result for -F(x); the proof for G{x) is similar. 

□ 

Prom this point on we shall be working in full generality, rather than 
concentrating on the particular examples of cyclic, separable or semisimple 
elements. We work directly with generating functions derived from cycle 
indices. For background on cycle indices of finite classical groups, sec [6]. 
The paper [19] is another useful reference and works out examples of cycle 
index calculations for GL((i, and M(d, g). 

Definition 9. Let k he a (possibly infinite) set of partitions of positive 
integers. Let a he an element of a finite classical group G. For each monic 
irreducihle polynomial f overFg, define Xf{a) to he the partition whose parts 
are ai . . . an, where f""^, . . . , are the powers of f amongst the elementary 
divisors of a. 

(1) If G E {GL, U}, we say a is of A-type if the partitions A/ (a) are all 
either empty or in A. 

(2) //G = Sp, we say a is of A-type if the partitions A/ (a) for f ^ z±l 
are all either empty or in A, and A2;±i(a) are empty. 
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Definition 10. Define Aq^^^ to be the probability that a randomly chosen 
element ofG{d,q) is of A-type, and Aq^^^^-j to be the limiting probability as 
d increases, the limit being taken only over even values of d if G = Sp. (The 
existence of this limit is explained in the proof of Theorem 13.) 

Remark: The requirement in Definition 9 that A^-ti should be empty 
in the symplectic case is for convenience. Limiting probabiUties without 
this restriction arc obtained by multiplying limiting probabilities with this 
restriction by a factor corresponding to z — 1 and a factor corresponding to 
z + 1. These factors are easily understood in any particular case. 



We define quantities Cgl,a(9'^) ^^nd Cu^x{q'^) which appear when working 
with cycle indices. These quantities are sizes of certain centralizers, but we 
do not need this fact and shall define them by formulae. 



Definition 11. Let X be a partition with rrii parts of size i for all i, and let 
k{X) = 2 J2i<j imirrij + - l)m? . Then 

i 

= n "i"^^^"^ - 1) • • • (g*^ - 1), 

i 

i 
i 

The following lemma will be useful. 

Lemma 12. (1) — — , = — j- -rr- — ; ^• 

^ ' Cgl,a(«'^) - q-'^) •••(!- q-""^) 

V ^ ="! I 

CvAq'') ^"'^(1 + q-'') •••(!- (-1)"?-"'^) ■ 

Proof. The first assertion may be found in [19]; it is a consequence of Fine 
and Herstein's count of nilpotent matrices [5] . For d=l the second assertion 
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follows from the first, since 



For general d replace qhy q'^. □ 

We are now in a position to establish a principal result of this section. As 
mentioned earlier and as explained after the proof of Theorem 13, there is 
no need to state results for orthogonal groups. 



Theorem 13. Let A be a set of partitions of positive integers. Then Aq(^ 
may be expressed as a power series in q"^ whose coefficients are integers if 
Gg {GL,U, Sp}. 

Proof. If A does not contain the unique partition of 1, it is not hard to 
show that Ag(oo,5) = (this also follows from Theorem 25 in the case of 
GL). We shall therefore suppose throughout that A does contain this parti- 
tion. Throughout the proof we use the notation that if A{u) = Yl cinU^ and 
B{u) = J^bnu"', then A{u) <C B{u) means that a„ < bn for all n. We also 
assume familiarity with cycle indices of finite classical groups [6]. 

(1) Suppose G = GL. In this case we may specialize the general linear 
group cycle index to get 



d>i d>i \ AeA "^GL.AW ; 



N{d,q) 



By applying part (a) of Lemma 4 with x = q u, this may be written 



as where 



A{u) = (1 - q-'u) n 
d>l 



Nid,q) 
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From part 1 of Lemma 12 and the fact that (1) € A, it is not hard 
to see that 



n 

d>l 



(1 - g- V) 1 + ^ 



U 



d\X\ 



« n 1+ 



u 



N{d,g) 



,nd 



N{d,q) 



nd 



d>l \ ^ n>2 ^ 



N{d,q) 



The last step used the fact from [16] that (^i_g-iy,(^i_g-„^ < 4 for 
all n and q > 2. Thus is analytic in an open disc of radius 
except for a simple pole at u = 1. It follows that Agl(oo,(j) is equal 
to the residue at that pole, which is 



(i-.-)n 



d>l 



AeA 



CGLAq^) 



N(d,q) 



We can certainly find integers {ai) such that 



-di 



An argument similar to that of the previous paragraph shows that 
the product 



Nid,q) 



„d'i 



d>l 



converges absolutely for |x| < q~^, and hence we may appeal to 
Lemma 5 to show that F{q~^) has integer coefHcients in its expan- 
sion; since AGL(oo,g) = (1 ~ q~^)F{q~^), this is enough to prove this 
case of the theorem. 
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(2) Suppose next that G = U. By specializing the cycle index of U{d, ( 
we obtain the identity 



1 + 

d>l 



,2</|A' 



M{d,q) 



d odd 



aga ^'^^^ ' / d>\ \ 
which by means of part (b) of Lemma 4 (with x = q~^u) can be 
rewritten as 

N{d,q) 



1-u 



n 

d odd 



(1 



u 



d\\\ 



AeA 



n 

d>l 



[1 - .-^v^) [i+y: 



2d\X\ 



AeA 



CGL,x{q 



2d\ 



M{d,q) 



Arguing as in the G = GL case (but using both parts of Lemma 12), 
one sees that apart from the explicit simple pole at n = 1, this is 
analytic in an open disc of radius . Hence the value of Au(oo,q) is 
equal to its residue at u = 1. This is equal to 

N{d,q) 



n 

d>l 



d odd 



1 



1 M{d,q) 



AeA 



We can find integer sequences (a,) and (bi) such that for all d, 

Let us consider Cu,a(9'^) and Cgl.aC?'^) as polynomials in q. It is 
clear from the definitions of these quantities that the difference of 
the coefficients of these two polynomials is even for any given power 
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of q. It follows easily that the difference of the reciprocals C\]^\{q'^)~^ 
and Cgl,a('?'^)~^) when expanded as a power series in g^^, will have 
even coefficients, and hence that — hi is even for all i. Define 



N(d,q) 



M{d,q) 



^(^)= n i+E 



n i+E". 



,2di 



d odd 



d>l 



As in the case G = GL, both factors in the product F{x) converge 
absolutely when \x\ < q"^. We now invoke Lemma 8, which tells 
us that the expansion of F{q~^) in powers of q~^ has integer co- 
efficients. But then this is also true for Au(oo,q)5 which is equal to 
il+q-^)F{q-^). 

(3) Suppose G = Sp. Specializing the cycle index of Sp(2d, q) gives the 
identity 

l + E^Sp(2<i,,)«'' = 
d>l 



n i+E 



u 



d\X\ 



N*(2d,q) 



d\X\ 



M*(d,q) 



d>l 



AeA 



Cu,x{q'') 



d>l 



aga 



Using part (d) of Lemma 4 with x = q ^n, and arguing as in the 
previous cases, one deduces that Asp(oo, q) is equal to 

N^2d,q) 

(l_g-l)e(.)-Q ■ 



d>l 



n 

d>l 



AgA 
1 



M*{d,q) 



AeA 



The remainder of the argument is similar to the previous cases. 



□ 



Remark: As mentioned in the introduction, the limiting orthogonal 
probabilities are simple functions of the limiting symplectic probabilities. 
If (1) A, it is not hard to show that all limiting probabilities are (for 
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instance one could use an argument similar to that of Theorem 25). To han- 
dle the case (1) € A, we extend an idea from [10] for the cases of separable, 
cyclic, and semisimple matrices. Suppose for example that the dimension 
of the space is even and that Xz±i are empty. Then if one considers the 
0-dimensional space to be of positive type, the sum of the cycle indices for 
the positive and negative type orthogonal groups is equal to the cycle index 
of the symplectic groups. Thus Ao+(oo,q) + ^0-(oo,g) = ^Sp(oo,g)- If one lets 
X{u) denote the difference of the cycle indices for the positive and negative 
type orthogonal groups, then arguing as in [10] (or using Lemmas 2.6.1 and 
3.7.2 of [20]) one deduces that 

^<"'^n(-E^) n(-E^) . 

It follows that X{u) is analytic in an open disc of radius q^^^, which implies 
that ^o+{oo,q) = ^0-{cx>,q)j ^'^d hence that both of these probabilities are 
equal to I^Mp^ ^o prove the analyticity assertion about X{u), one uses 
the fact that (1) € A and part (f) of Lemma 4 with x = q^^u to write X(u) 
as 

/ ^N*i2d,q) . \M*{d,g) 



d>l ^ \'i ' J / \ \'i J 



— 19 / 1 _ M I 



N*{2d,q) 



n 



(1 - q-^u)<i)-\l + q-^u)<i) \ (1 - ^) 



n 



(1 + ^) 



d>i \ y-"-^ 1^ 

Then one argues as in the G = GL case of the proof of Theorem 13. 



As a corollary of Theorem 13, we answer one of the questions raised in 
[10] . Note that O refers to an orthogonal group on an odd dimensional space, 
and that refer to orthogonal groups on an even dimensional space. 
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Corollary 14. The coefficients of powers of q in the limiting probabilities 



for the cases 

(1) S(5± in even characteristic, 

(2) C(3± in odd or even characteristic, 

(3) ssq± in odd or even characteristic. 

For these three cases, the coefficients are half-integers. 

Proof. This is clear from Theorem 13 and the formulas for limiting proba- 



The following theorem is a somewhat curious outcome of our study of 
parity. This relationship is interesting because as mentioned in the introduc- 
tion, there are simple exact formulas for the limiting proportion of regular 
semisimple, cyclic, and semisimple matrices in the general linear case, but 
in the unitary case it is not even known which of these limiting proportions 
is a rational function of q. 



Theorem 15. Let A be a set of partitions of positive integers containing 
(1). Wnte 



■5g(oo,<?), ssGCoo.g), CG(oo,q) (^^c integers for G G {GL, U, Sp, O, 0+, O } except 



bilities in [10]. 



□ 





i>l 



Then — bi is even for all i. 



Proof. Let us write 
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Then as we observed in the proof of Theorem 13, Vi — Wi is even for aU i, 
and 



A- 



U(oo,q) 



d odd 



>1 ViQ-'^'- J 



N(d,q) 



M(d,q) 



n i+E 



n i+E 



Viq 



-2di 



d odd 



i>l 



d>l 



i>l 



Following our usual procedure, we use Lemmas 1, 2, and 7 to transform this 
into the form 

-di \ yiN{d,q) 



d odd i>l 



l-q- 



+ q- 



-di 



X 



n ~ q-diyiN{d,q) JJ JJ^j _ ^-2diyiM{d,q) 



d odd j>l 



d>l j>l 



for integer series (yj) and (zj). Now we use parts (c) and (b) of Lemma 4 to 
obtain 



Au(oo,q) = (1+9 



n 



1 



On the other hand, by the proof of Theorem 13 and part (a) of Lemma 4, 
we may write 

/ \ N{d,q) 

Agl(oo,.) = (1-5-^)11 i+E^^«~'M 

d>l \ i / 

,1— j \ 



Therefore 



Au(oo,g) _ 1 + g ^ T-r 

1-a-i 



A, 



GL(oo,g) 



1 + r 



2 \ 



1-q 



1 + q^-^ 



the expansion of which has even coefficients (since does) . The theorem 

now follows from Lemma 7. □ 
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3. Integrality of Finite Dimensional Coefficients 

This section proves an integrality result for the coefficients of probabilities 
in a finite classical group when expanded as a power series in q~^. Here the 
group is fixed, so the result is non-asymptotic, which removes the need to 
deal with issues of convergence. For the special cases of regular semisimple 
elements in the setting of Lie algebras rather than Lie groups, the paper [13] 
gives interpretations of this result in terms of topology and representation 
theory of the Weyl group. The argument presented here is very much in the 
spirit of Section 2, but now one needs the following variations of Lemmas 1 
and 2 which involve power series in two variables. 

Lemma 16. Let f{u, q~^) be the formal power series 1 + Yli<i j ■ 
Then there exists a unique sequence (bij) such that 

fiu,q-')= Hil-u'q-^f-K 

The sequence (bij) consists of integers if and only if every aij is an integer. 

Proof. The proof is nearly identical to that of Lemma 1, except that the 
exponents bij are defined by induction on n := i + j. Thus we define 

bk,n—k Ojk,n—k ~l~ Ck,n—ki 

where cj-^n^k is the coefficient of u^q~^'^~^) in the expansion of 

JJ {l-u'q-^f^'K 

i<k 
jKn—k 

It is a straightforward matter to show that the 6jj satisfy the statements of 
the lemma. □ 

Lemma 17. Let [aij) be a sequence of even integers. Let f{u,q~^) be the 
formal power series i+Yli<i j ^1,3"^^ Q~'' ■ Then there exists a unique sequence 
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bij) such that 



The sequence (bij) consists entirely of integers if and only if every (aij) is 
an even integer. 

Proof. The argument is a straightforward modification of Lemma 2, except 
that the bij are defined by induction on i + j, as in Lemma 16. □ 

Now the main result of this section can be proved. 

Theorem 18. Let A be a set of partitions of positive integers. Then Aq(^ 
may be expressed as a power series in whose coefficients are integers if 
Gg {GL,U, Sp}. 

Proof. The three cases are treated separately. For background on cycle 
indices of finite classical groups, see [6]. 

(1) Suppose that G = GL. The general linear group cycle index gives 

N{d,q) 



i+E^GL(.,,)^''=n(i+E 

d>l d>l \ AeA 



u 



d\\\ 



By Lemma 16 and part (a) of Lemma 4, this can be rewritten as 

N{d,q) 



d>l \l<i,j ) l<i,j 

This implies the result in the G = GL case. 
(2) Suppose that G = U. Specializing the cycle index of the unitary 
groups gives that 



1 + 



d>l 



^d\X\ / ^2d\X\ \^('^''?) 



n h+E™ n 



dodd \ AeA ^'^^^ '/ d>l \ AeA 
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Using the equation C\j^\(q) = (— 1)I'^ICgl,a(— <?) and Lemma 16, this 
can be written as 



n n(i 

d odd \ l<j,j 



Nid,q) 



,2id 



M(d,q) 



n nd-^)'"' 

d>l \l<i,j ^ 



By part (b) of Lemma 4, this is 



n('"''^'"'V"'n 



n 



(1 - (-i)'+%*V^''^)A^' 

(1 - u^'^q-i'^) 



N{d,q) 



When one writes 



- j „,id„—jd\ \ 



11 A, (i-..v^.i) ; 



the Cjj- are clearly all even. Thus, applying Lemma 17 and then part 
(c) of Lemma 4 gives that 



d>l 



1 — « (7 



i^l—j \ 



n 

d odd 



1-u 



id ^jd \ ''i.j 



N(d,q) 



l-u'q^-^\^'-' 
+ u^q~^ 



yr /{l-u'q-^){l-u'q^-^] 
,y . \ {l+u'q-^){l+u'q^-^] 



This implies the result for the case G = U. 
(3) Suppose that G = Sp. The argument is similar to the unitary case. 
Using Lemma 16, then part (d) of Lemma 4, followed by Lemma 17 
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and part (e) of Lemma 4, it follows that 
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Sp{2d,q)'> 



d>l 



n i+E 

d>l \ AgA 



,d\\\ 



N*{2d,q) 



- n n(i- 

d>l \l<i,j 



n i+E 

d>l \ AgA 
N*{2d,q) 



U 



d\\\ 



M*{d,q) 




u 



id 



M*{d,q) 




N*{2d,q) 



Hi 



N*{2d,q) 



This completes the proof for the case G = Sp. 



□ 



Remark: The case of the orthogonal groups is easily understood using 
the above approach. Suppose for instance that the dimension is even and 
that Axil are empty. Then considering the dimensional space to be of 
positive type, the sum of the cycle indices of the positive and negative type 
orthogonal groups is equal to the cycle index of the symplectic groups. So by 
Theorem 18, the coefficient of q"^ in the sum of the 0+(2d, q) and 0~{2d, q) 
probabilities is an integer. As in the remark after Theorem 13, let X{u) 
denote the difference of the cycle indices for 0+(2d, q) and 0~{2d, q). Then 
as before X{u) is equal to 



ii I ' + Z^ CuA(g'^) 

d>l V AeA ^'-^^^ ' . 



N*{2d,q) 



n i+E 



u 



d\\\ 



M*{d,q) 



d>l 



AeA 



CGL,A(g'^) 
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which in the notation of the G = Sp case of Theorem 18, is equal to 

/ sN*i2d,q) I \M*{d,q) 

J] I ]J (1 - {-lyu^'^q-^'^f'-^ j ( n (1 ~ u^'^q-^'^f^'^ I 

d>l \l<i,3 ) \l<i,j / 

This is slightly different from the cycle index of the symplectic groups since 
the power of (—1) in the first factor is different, but the same argument as in 
the G = Sp case of Theorem 18 shows that the power series expansion in 
for the coefficient of vf^ in X{u) has integral coefficients. Thus the coefficient 
of in the 0+(2d, q') and 0~(2d,q) probabilities is a half- integer. 



4. Rate of Stabilization of Coefficients 

This section studies the question of how large d must be so that the 
coefficient of g""" in ^G{d,q) is equal to the coefficient of q~'^ in ^G(^oo,q)- 
Subsection 4.1 obtains sharp results in the regular semisimple and cychc 
cases, when the group in question is GL or U. For these groups it is well 
known that an element is regular semisimple if and only if it is separable. 
Then Subsection 4.2 uses themes from earlier sections of this paper to prove 
a general stabilization result; while not always sharp it is broadly applicable. 

4.1. Stabilization for Regular Semisimple and Cyclic Probabilities. 

It should be noted that the regular semisimple case has been studied by 
several authors. Lehrer [13] obtained results in the setting of Lie algebras 
rather than Lie groups, but they were not sharp. Sharp results in types 
A,B,C for the Lie algebra case and for the GL case appear in [14] using 
topological methods. Wall [21] uses combinatorial techniques to obtain sharp 
results for GL and its Lie algebra for the regular semisimple case and cyclic 
case. The argument presented here has similarities to that of Wall [21], but 
seems different enough to record. Results are worked out for the general 
linear and unitary groups; similar methods will apply to the symplectic and 
orthogonal groups, but this is much more laborious. 
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Letting G denote GL or U, we use the notation that 

sg{u, q):=l + J2 ^'^^G{d,q) 
d>l 

and 

cg{u, g) := 1 + ^ u'^CG(^d,q)- 

d>l 

Here, as in the introduction, SG(d,<j) is the proportion of separable elements 
in G{d,q) and CG^^^^g) is the proportion of cyclic elements in G{d,q). 

Proposition 19. Xei F(a, s) = i EH.,aM^)(-l)'/''C^'tA''"') • '^^en 
Proof. Prom the cycle index of general linear groups [6], [19] , 



^e.p(ElEMO.-.og(..^)) 



- exp -E^EMO^^/^E-i^)- 

\ d>l r\d i>\ ^ ^ ^ ' I 

Defining s = ir and t = d/r, this becomes 



t„ st 



Letting a = rb, this becomes 

(^^sqi-s-ayi /s/r + a/r-l 



-EEE^^^V^JEmMm 

a>0 s>l t>l r|s,a 



a/r 



= nn(i-«v- 



-s—a^F(a,s) 
o>Os>l 
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□ 



As a consequence one has the following result, which is sharp in the sense 
that there are values of d (such as d = 4) for which the assertion would be 
false if the upper bound on n does not hold. Parts 2 and 3 of Theorem 20 
are known from [21]. 

Theorem 20. (1) The numbers 



are integers for all a > 0, s > 1. 

(2) The coefficients of q~'"' in SGL((i,g) '^'^'^ •SGL(oo,g) equal whenever 
n<d-l. 

(3) The coefficients of in CQi^(^d,q) o-i^d CGL(c!o,g) ^'^c equal whenever 
n < 2d. 

(4) The coefficients of q"^ in su(d,g) su(oo, g) are equal whenever 
n<d-l. 

(5) The coefficients of q~^ in cu(rf and cjj^oo,q) equal whenever 
n < 2d. 

Proof. For the first assertion, it follows from Theorem 18 that all coefhcients 
u'^q~^ in (1 + ■^^)sGL{u,q) are integers. Now consider the expression for 
(1 + ■^:i)sGL{u,q) in Proposition 19. If some F{a,s) were non-integral, 
let (a, s) be the smallest such, where smallest means to first compare the 
s coordinate, then if necessary the a coordinate. Then the coefficient of 
y^Sgi-s-a ^-^ _j_ _^^g^^^y^^ would be non-integral, a contradiction. 

For the second assertion, note by Mobius inversion that F{0, 1) = —1, 
F{0, 2) = 1 and that F(0, m) = for m > 2. Thus by Proposition 19, 




(1 - u)sGL{u,q) = 



(1 - u^q-^) 
(1 + ^) 



a,s>l 



Hil-u 



s l-s-a\F{a,s) 



POWER SERIES COEFFICIENTS FOR PROBABILITIES 27 

The integrality of the F{a, s) implies that q~'^ divides the coefficient of u"^^^ 
in (1 — u)sqi^{u, q). This coefficient is SGL(d+i,q) ~ ■SGL(d,g)) which proves the 
result. 

For the third assertion, it is proved in [21] that 

CGL{d+l,q) - CGL{d,q) = q ^ [sGL(d+l,q) ^ ''^GL{d,q)] ■ 

Thus by the previous paragraph, q~^'^~^ divides CQ^^^i^q-^ — CGL(d,g) ^ Si, 
polynomial, which implies the result. 

For the fourth assertion, note from Theorem 2.1.13 of [10] that 

, . gGL(n2,g2) 
sv[u,q) = . 

SGL{-u,-q) 

From the expression for {1 — u)sgl{u, q) in the proof of the second assertion, 
it follows that (1 — u)s\]{u,q) is equal to 

Thus Proposition 19 implies that q~'^ divides the coefficient of u'^^^ in 
(1 — u)s\]{u,q). This coefficient is Su(d+i,g) ~ S\]{d,q)-> &s desired. 
For the fifth assertion, note from Theorem 2.1.10 of [10] that 

CU(d+l,g) - Cu(d,g) = {-QT'^'^ [s\]{d+l,q) - S\]{d,q)\ ■ 

Thus by the previous paragraph, (jiyides Cu(ci+i,q) — Cu(d,5), which 

implies the result. □ 

4.2. A General Stabilization Result. This subsection gives an approach 
to finding the rate of stabilization of the finite dimensional coefficients to 
the limiting coefficients which is more general, in that it is effective for all 
A-types, though it does not give the sharpest possible results in all cases. 
We describe this approach only in the case of the groups GL((i, g), but it 
could be extended without difficulty to G G {U, Sp, O, O^}. 
We shall need the following extension of Lemma 16: 
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Lemma 21. Let S he a subset o/ N x N, closed under (componentwise) 
addition. Suppose that for integers aij 

l<i,j l<i,j 

Then aij = for all ^ S if and only if bij = for all ^ S. 
Proof. It is clear that the product 

n (l-nV^f-, 

(i.i)es 

when expressed as a power series in u and q^^, will only yield terms u^q^^ 
when (i, i) € S. This is enough to prove one half of the double implication; 
the other half follows easily from induction on n := i + j, using the explicit 
construction of bk^n-k given in the proof of Lemma 16. □ 

Let Ao be the set of all partitions of positive integers, and suppose that 
/ A C Aq. We find lower bounds for the rate of stabilization of the co- 
efficients of the polynomials Aqlj-^ ^) as d increases. We use two similar 
methods, one for the case when (1) € A, and the other for the case (1) ^ A. 
It is worth remarking that this particular distinction is intuitively reason- 
able; if (1) € A, then all separable transformations are of A-type, and it 
follows that Agl(oo,5) > SGi,{oo,q) > 0. But if (1) ^ A, it is easy to show — 
indeed our argument will show — that A.Q^^ q^ = 0. In the first case, our 
method will be to look at the difference A.Q^^ g^ — ^GL{d-i,q)-i ^^'^ show that 
it is divisible (as a polynomial) by a particular power of q~^. In the second 
case, we show that ^GL{d,q) itself is divisible by a power of q~^. 

For a non-empty partition A, define A(A) to be the degree of Cgl,a(9) as 
a polynomial in q. This degree may be expressed in several ways: 

Lemma 22. (1) Suppose that A has rui parts of size i for all i. Then 
(2) Suppose that Ui = Ylj>i''^j f'^'f ^- Then A(A) = ^^nf. 
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(3) Finally, suppose A has parts 04,..., a^, where ai > Oj+i for all i. 
Then A(A) = ^.(2i - l)ai = 2^.iai - |A| 

Proof. Definition 11 yields the first equation easily. The second follows from 
the first, via the observation that 5^j<j irriimj = Ylk>i Ylk<i<j f^i'f^j- The 
third follows from the first by observing that, if fls+i, . . . ag+mi are the parts 
of size z, then + — l)o^s+fc = 2ismi + imf. Now use the fact that 

s = rrij, and sum over i. □ 

It can be established easily (using any of the expressions for A(A) above) 
that if #(A) denotes the number of parts of A, then 

|A| < A(A) < |A|#(A) < |A|2. 

Each of these inequalities may in fact be equality, and in each case this 
imposes a regular structure on A; in particular, we remark that |A| = A(A) 
if and only if A has a single part. 
Define 

TA{u,q) :=Y, 



Then by the cycle index of GL(n, q) ([19], [6]) 

1 J- -r -tAV 

d>l d>l 

Setting A = Ao shows that 

, Nid,q) 1 



(3) i+E^GL(d,,)^'= n {^+TA{u^,Q')y 



1-u 



d>l 

If we write A'^ for the complement Aq \ A, then we obtain from (3) the 
following equation: 

1 . g (Ac.,,,, - A,,,_,„) ^ n (1 - • 

Here AGL(o,q) is to be interpreted as 1. 

Now 1 + T\g{u, q) may be written in the form 1 + 5^i<j<j Vi^jU^q'^ Its 
reciprocal can also be put into this form, since the modification of Lemma 
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16 in which ah occurrences of 1 < i,j are replaced by 1 < i < j is true. In 
fact it is shown in [19] that (1 + T\^^{u, q))~^ = nr>i(-'- " foHows 
that there are integers Uij such that 

1+Tao{u, q) 



2<i,j 

Note the condition 2 < i,j on the index of summation, which is vahd since 
A'^ does not contain the partition (1). In fact it is easily shown that if 
ttij ^ 0, then there exists a partition A in A"^ such that i > |A|, j > A(A), 
and j — i > A(A) — |A|. Let S be the set of all pairs satisfying this 
condition. Then S is obviously closed under addition, and it follows from 
Lemma 21 that we can find integers bij such that 

l + TA,iu,q) 

Now by our usual argument, invoking Lemma 4, part (a), 

4U l + TA,iu^q^)J ^n^Vl-nV 
which may certainly be put into the form 

(1 - u'q-^y^-j 



for integers Cjj. 

Define a := inf {j/i \ + 1) G S}. Then the set {(i, j) | j > icr} is 
closed under addition. By Lemma 21 it follows that, for some integers eij, 
we may write 

j>ia 

Then from (4) above, it follows that for all d, 

^GL((i,g) -^GL(d-l,q) = XI '^d,jQ~^ , 

j>da 
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and hence that, whenever j < (d+ l)cr, the coefficient of in AQL(d^g) has 
stabihzed to the coefficient in the hmit ^GL{oo,q)- 

What is the ratio a? Firstly, suppose that A'^ contains at least one parti- 
tion with a single part, and suppose that the smallest such partition is (k). 
Then A ( (A;) ) = k, and it is clear (since A(A) > |A| for partitions with more 
than one part) that a = Suppose, on the other hand, that A'^ contains 
no one-part partition. Then it is clear that > 1 for any G S. But 
it is also clear that by taking i and j sufficiently large, we can make this 
ratio arbitrarily close to 1, and hence that a = 1. 

We summarize these conclusions in the following theorem: 

Theorem 23. Suppose { (1) } C A C Aq. Define 



a := < 



1 — I if k is the size of the smallest one-part partition not in A, 
1 if A contains all one-part partitions. 



Then the coefficient of q ^ in Aqi,^^^ ^-^ is equal to the coefficient in AQ^^ q-^ 
whenever j < {d-\- l)a. 

We have the following applications to cyclic, separable and semisimple 
matrices: 

Corollary 24. (1) The coefficients of q~^ in cgl(^ and CGL(oo,g) 
equal whenever j < d. 

(2) The coefficients of q~^ in SGL(ci,g) O'l^'d sql(oo are equal whenever 

J — 2- 

(3) The coefficients of q~^ i'n ssQ,i^(iji^q^ o-n^d ssQ^^^q^ are equal whenever 
i < - 



Comparing with Theorem 20, these bounds are not sharp for the cases of 
SGL{d,q) ^'Hd CGL(<i,9)- However it is not at all clear that the methods of [14], 
[21], or Theorem 20 can be adapted to the semisimple (or other) cases. 
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We now deal with the case when (1) ^ A. Let k be the smallest integer 
such that A contains a partition of k. For each i > k, define 

n := min{^ | A e A, |A| < i}. 

Write 

l+TA{u,q) = l+J2 ai,ju'q-K 

Note that i,j > 2 since (1) ^ A. Also it is not hard to see that ajj = 
unless j > iTi- Furthermore, since is weakly decreasing function of z, the 
set S := {(^, j) | j > in, i,j > 2} is additively closed. By Lemma 21, there 
are integers bij such that 



Now, proceeding as usual by means of part ((a)) of Lemma 4, we find that 

d>l (i,j)&S ^ ^ ^ 

which can be rewritten in the form 



(5) n (i-A-^T^- 

Suppose Cij 7^ 0. Then there is a partition Aj such that |Ai| < i, and 
^^ > But now 

J^A(A,) l.^A(A,) 1 _ A(A0-1 ^^ 
i " \Xi\ i " \Xi\ \Xi\ ~ 



where a := inf{^^^ | A G A}. The set \ j > ia, i,j > 1} i 



IS 



additively closed, and so (5) may be written, by Lemma 21, in the form 



for integers eij. 
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Now from (3) above, the expression at (5) is equal to 1 + X^d-^GL(d,g)^'^- 
It follows that 

which suffices to prove the following theorem: 

Theorem 25. Suppose that 7^ A C Aq and that (1) ^ A. Define 

a := mf{ \' | A € A}. 

Then whenever j < da, the coefficient of in ^G'Lid.q) is 0- 

The constant a is likely to be fairly easy to calculate for most naturally 
arising sets A. If A contains one-part partitions, and {k) is the smallest, 
then cr = 1 — p If A has no one-part partitions, then a >1. 
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